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BACXGROXmD OF TBE INVENTION 

Lio 1 . Field of the invenrion 

g The present invention relates to a method for object 

^ voice processing, a program execurion device for executing 

M= a voice processing program, a recording medium having 

y recorded therein a voice processing program, and a voice 

[|s processing program; all of which are preferably applicable 

m to video gai5,e machines or entertainment devices having video 

%J game function. 

2. Description of the Related Art 
2® In recent yearS|. there are widely popularized video game 

inachineB for executing video games based on game progr-ams 

which are stored in storage media such as CD-ROM, DVD-ROM and 

semiconductor memory. 

Such video game machine is designed to allow a player 
25 to manipulate a game object which appears on a display screen 

through operating a controller plugged into the main unit of 
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the video game machine- Thus, the player can enjoy a variety 
of video games including RPG (Role Playing Game) , AVG 
(Adventure Gam^) and SLG (Simulation Game) 

However in the conventional video game machine, the 
5 player could nvanipulare a game object only by operating the 
controller in hand, so that the player could only dedicate 
itself to operation of the conrroller in silence, which was 
less atrr^^Qpive in terms of ©njoyment of manipulating the t^ame 
Ob j ©ct . 

SUMJO^T OF THE IHVEHT10» 

=7i ThG present invention was proposed to address the 

^ foregoing problem, and an object thereof resides in that 
y providing a method for voice processing, a program execution 
0^ device for executing a voice processing program, a recording 
1^,^^^ medium having recorded therein a voice processing program, 
and a voice processing program; all of which allow the player 
to manipulate a game object using the player'' s voice to 
thereby enhance enjoyment of the video game and pleasure of 
20 manipulating the game object. 

The present invention detecrs a voice tone based on input 
voice information, and then outputs voice data having a voice 
tone corresponded to the detected voice tone. More 
specifically, in the present invention, when a player inputs 
25 some voice, a game object responds in a voice tone 

corresponded to the player's voice tone. This allows the 
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player "Co operate a game object through voice input, and 
enhances enjoymeni: of rhe video game and pleasure of 
manipulating the game object. 

Since the player's voice tone can be simulated by the 
game objecr's voice tone, also the personality of the player 
can be simulated by the personality of the game object- This 
successfully makes the player feel familiar to the game object 
and promotes empathy of the player- to thereby furtb^ar enhan;?© 
the enjoyment of the video game. 

Other and further objects and features of the present 
invenrion will become obvious upon understanding of the 
illustrative eml3odiment about to be described in connection 
with the accompanying drawings or will be indicated in the 
appended claims, and various advantages not referred to 
herein will occur to one skilled in rhe art upon employing 
of the invenrion in practice. 

BRZBF DBSCRXPTXON OF THE PRAWZM6S 

Fig. 1 Is a block diagram of a video game machine 
according to an embodiment of the present invention; 

Fig, 2 is a perspective view of a controller connected 
ro the video game machine of the embodiment; 

Fig. 3 is a perspective view showing a head set worn 
by a player in order ro operate through voice a leading 
characrer of a video game executed by the video game machine 
of the embodiment; 
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rig. 4 is a drawing o£ an exemplary game scene displayed 
on the video game machine of the embodiment; 

Fig, 5 is a table showing exemplary parameters of the 
leading character appears in rhe video game executed on the 
5 video game machine of the embodiment; 

Fig, € is a table showing exemplary parameters of an 
enemy character appears in the video game executed on the 
video game machine of the embodiment; 

Fig. "7 is a table showing exemplary parameters of arms 
flo owned by the leading character appears in the video game 
U execured on the video game machine of the embodiment; 
lij rig. 8 is a flow chart for explaining voice input 

operation for the video game machine of the embodiment; 

s ; 

« V, s 

^ Fig, 9 is a table showing exemplary parameters used when 

the leading character in a normal psychological state is 

III displayed® ffinder control on the video game machine of the 
embodiment; 

"^"^ Fig. 10 is a table showing exemplary parameters used 

when the leading character encounters with the enemy 
ao character in the video game machine of the embodiment; 

Fig- 11 is a schematic drawing showing a player giving 
through voice input an instruction to the leading character 
on a display screen of the video game machine of rhe 
embodiment; 

25 Fig, 12 is a schematic drawing showing a scene in which 

the leading character instructed by the player's voice input 
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is figuring wirh the enemy character on rhe video game machine 
of the embodimenr; 

Fig. 13 is a tablQ showing parameters used when, upon 
encountering with the enemy characrer, the leading character 
runs away therefrom on the video game machine of the 
embodiment . 

^ flow chart for explaining control of voice 
tone m voice ourput of the leading character corresponding 
to voice tone in voice input of the player on the video game 
machine of the embodiment; 

Fig* 15 is a chart for explaining exemplary positive 
responses of rhe leading character corresponded ro voice tone 
in voice input of the player on the video game machine of the 
embodiment; and 

Fig. 16 is a chart for explaining exemplary negative 
responses of the leading character corresponded to voice tone 
in voice input of the player on the video game machine of the 
embodiment . 

DSTAXI.&D DfiSCRZPTZOlT OF TBE PRBFBRRSD EMBODIMENTS 

The pr-esent inventigjn is applicable, for example, ro 

a video game machine as shown in Fig. 1. 
General Constitution of Video Game Machine 

The video game machine shown in Fig. 1 comprises a main 
unir 1 for executing a battle-type video game described below, 
a controller 2 to be handled by a player, and a head set 3 



having integrated therein a sound outputting portion for 
outputting effective sound and so forth o£ such video gsime 
and a microphone set for picking up player's voice. 

The main unit 1 comprises an operational command input 
section 11 to which operational commands are supplied from 
the controller 2 handled by the player, a voice level 
detection section 12 for detecting player' s voice level based 
on sound signals transmitted from the microphone of the head 
set 3, a voice recognition section 13 for recognizing meaning 
of player's voice based on voice signals transmitted from the 
microphone of the head set 3, and a counter 10 for obtaining 
tone-based statistics of the player's voice by counting the 
player' s voices as being classified into those of polite tone, 
gentle tone and so forth. 

The main unit 1 also has a parameter storage section 
14 for storing parameters expressing the number of enemies, 
apparent fearfulness, distance between the leading character 
and an enemy character and so forth read out from an optical 
dislc 19; a selection/event table storage section 20 for 
storing a plurality of selection tables classified by the 
individual categories, where each selecrion table coiupris^s 
a plurality of event tables and each event table contains a 
plurality of events expressing behaviors of the leading 
character and enemy characters; an optical disk: reproduction 
section 15 for reading out such parameters or game programs 
from the optical disk 19 loaded thereon; a display processing 
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section 16 responsible for the controlled display of game 
scenes oA€6 a display device 18,- and a control section 17 for 
controlling entire porrion of such video game machine. 
ConsriruTrion of Controller 
5 An appearance of the controller 2 is Shown in Fig. 2. 

As is clear from Fig. 2, the controller 2 has two grip ends 
20R, 20L so as to allow a player to grip such grip ends 20R/ 
20L with the right and left hands, respecrively ^ ro thereby 
hold the controller 2. 
10 The controller 2 also has first and second operational 

□ portions 21, 22 and analog operational portions 23i. at 

|]j positions operable by, for escample, the individual thumbs 

B !; S 

[T; while holding the grip ends 20R, 20L with the right and left 
?z handS/ respectively. 

^15 The first operational portion 21 is responsible 

r typically for instructing an advancing direction of the game 
character, which comprises an upward prompt button 21^ for 
prompring upward direction, a downward prompt button 2lb for 
prompting downward direction, a rightward prompt butron 21e 
20 for prompting- rightward direction, and a leftward prompt 
button 2ld for prompting leftward direction* 

The second operational portion 22 comprises a ^^A" 
button 22a having a '"A"' marking, a x " button 22b having 
a X " marking, a *^0" button 22c having a **0" marking, and 
25 a ^^D" faii^tPt'isn 22d. having a ^"O" marking. 

The analog operational portions 2311, 23L are designed 
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to- be kept upright ( nor- inclined state, or in a referential 
position) when they are nor Inclined for operation, but when 
zhey are inclined for operation while being pressed down, a 
coordinate value on an X-Y coordinate is detected based on 
5 the amount and direction of the inclination from the 

referential position, and such coordinate value is supplied 
as an op^r^^tional output via the not-illustrated controller 
plug-in portion to the main unit 1. 

The controller 2 is also provided with a start button 
10 24 for prompting the game start, a selection button 25 for 
J selecting predetermined subjects, and a mode selection switch 
J 26 for toggling an analog mode and a digital mode. When the 

2 analog mode is selected with the mode selection switch 26, 
a light emitting diode 27 (LED) is lit under control, and the 

15 analog operational portions 23Z. are activated. When the 

y digital mode is selected^ a light emitting diode 27 (LED) is 
turned off under control, and the analog operational portions 

3 23R, 231. are deactivated. 

The^ controller 2 is still also provided with a right 
20 button 28 and a left button 29 at positions operable by, for 
example, the individual second flxigsrs (or third fingers) 
while holding the grip ends 20R, 20L with the right and left 
hands, respectively. The individual buttons 28/ 29 comprise 
first and second right buttons 28R1, 28R2 and first and sscond 
25 left buttons 291.1, 29L2, respectively, aligned side by side 
in the direction of the thickness of the controller 2. 
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The player is expected to operate these burt-ons ro enter 
operational commands for the video game machine or 
characrers . 

Constitution of Head Set 

As shown in Fig- 3, rhe head set 3 is typically designed 
for single-ear use, and has a fitting arm 5 for fitting the 
head set 3 onto the player's head, a sound outputting portion 
6 provided at an end of the fitting arm 5# and a microphone 

7, 

The fitting ar-in 5 is designed in a curved sliape so as 
ro fir the human head profile, and so as to lightly press both 
sides of the player's head with both ends thereof, to thereby 
attach the head set 3 onro the player's head- 

The sound outputting portion £ has a pad portion 6a which 
can cover the entire portion of the player's right (or left) 
ear when the head ser 3 is fitred on rhe player's head, and 
a speaker unit €3» for outputting effective sound and so forth 
of the video game. The pad portion 6a is composed, for example, 
of a soft: material such as sponge so as to avoid pain on the 
player' s ear caused by wearing such head set 3 for a long time. 

The luicarophone 7 is parovided on the end of a microphone 
arm 7a, the opposite end of w^iich being attached to the sound 
outputting porrion 6. The microphone 7 is designed to be 
positioned close to the player's mourh when the head ser 3 
is firred on the player's head, which is convenient for 
picking up player's voice and supplying sound signals 
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corresponded thereof through a cable 8 to rhe voice level 
detection section 12 and the voics recognition section 13 of 
the mam uifiit !♦ 

Although the following explanation deals with the head 
set 3 designed for single-aar use, it should be noted that 
the binaural specification is also allowable such as a general 
headphone • The sound outputting portion may havd an 
inner-type earphone, which will be advantageous in redi2cin<g 
the size and weight of such head set. 

It should also foe noted that while the head s^t 3 herein 
is designed to be fitted on the player' s head using the fitting 
arm 5, it is also allowable to provide a hook to be hung on 
either of the player's ears, to thereby allow the head set 
to be fixed on one side of the player's ear with the aid of 
such hooV.'^ 

Executive Operation of Video Game 

Next, executive operation of a battle-type video game 
on the video game machine of this embodiment will be 
explained. 

In this battle-type video game, a leading character 
moves from a staxt point ro a goal poin-c along a predetermined 
route, during which the leading character encounters with 
enemy characters- Thus, the player operates the controller 
2 and also speaks to the leading character in the displayed 
scene through the microphone 7 of the head set 3 to encourage 
it .or make such leading character fight with enemy characters 

10 
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while giving instructions on the battle procedures. The 
player thus aims at the goal while defeating the enemy 
characters in such fights. 

In the execution of such battle-type video game, the 
player loads the optical disk 19 having stored therein such 
battle-ty|>e video game into the main unit 1, and then press 
the start button 24 of the controller 2 to prompt the game 
start. An operational command for prompting the game stazrt 
is then supplied through the operational command input 
section 11 to the conrrol section 17 so a.s to control the 
optical disJc reproduction section 15, to thereby reproduce 
a game program, rhe individual parameters for the leading 
character^ enemy characters and arms owned by the leading 
character, a plurality of event tables containing a plurality 
of tabulated events expressing behaviors of the leading 
character and enemy characters, and a plurality of selection 
table comprising a plurality of event tables classified by 
the individual categories and so forth. 

The control section 17 stores under control the 
individual parameters reproduced by the optical disk 
reproduction section 15 into the parameter storage secrion 
14, and the individual selection tables and event tables into 
the selection/event table storage section 20* 

From such optical disk 19, also reproduced is voice 
information provided for the individual voice tones of the 
leading character 31 as described later- The voice 
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informarion provided for the Individual voice tones are 
stored under conrrol in tha selection/event table storage 
section 20, and are properly read out by the control section 
17 to be supplied to the head set 3 worn by the player. 
5 The control section 17 also generates a game scene of 

the battle-type video game based on the game program 
reproduced by the optical disk reproduction section 15 and 
operation thorough the controller 2 by the playei:, and then 
displays such scene on the display device 18 after processing 
10 by -the dl&^lay processing section X6 , 

Fig, 4 shows one scene of such game, in which a leading 
character 31 encounters with an enemy character 32 during tne 
travel along the travel route, and points arms 33^ such as 
laser beam gun^ at the enemy character 32. 
IS Parameters 

The leading character 31, enemy character 32 and arms 
33 used by the leading character 31 are individually provided 
with parameters allowing real-time changes. 
Leading character Parameters 

Parameters owned by the leading character 31 are 
composed as shown in Fig. 5^ whicli rypically include vital 
power (ir=f«t>f mental power, apparent fearfulness, skill level, 
accuracy level, residual number of bullets on the arms 33, 
enemy search ability, attack range, direction of field of view 
(forward field of view), motional speed (speed), terror, 
offensive power, defensive power, continuous shooting 



12 



20 



25 



scoiaososoo 



ability of rhe arm 33, damage score (damage counter), 
decreasing rare of bullets in a magazine of the arm 33 
(consumption level of magazine), angle of field of view, 
sensitivity of field of view (field of view (sens©)), 
stiort-dlsrance offensive power, middle-distance offensive 
power, long-distance offensive power, dodge skill from 
short-distance attack by rhe enemy (dodge characteristic), 
dodge skill from middle-distance attack by the •n.my, dod?r» 
skill from long-distance attack by the enemy, endurance power 
against shor-t-distance attack by the enemy (defensive 
characteristic), endurance power against middle-distance 
attack by the enemy, and endurance power against 
long-distance attack by the enemy. 

Among' these, vital power, offensive power, defensive 
power, and damage score are expressed by values from 0 to 255, 
which decrease depending on damage caused by the enemy. The 
motional speed is expressed in 16 steps from 0 to 15, The 
subjects listed from ^^mental power" zo ^^enemy search ability", 
terror, consumprion level of magazine, and subjects listed 
from "short-distance offensive power" to '^endurance power 
against lon^-dist ance attack" are expressed in percent (%) . 

The continuous shooting ability is expressed by the 
number of frames for displaying such continuous shooting. 
The attack range, direction of field of view (forward field 
of view) , angle of field of view, and sensitivity of field 
of view are" individually expressed in a unit of ^^maya"- 
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Enemy Characrer Parameter^ 

Parameters owned by the enemy character 32 are composed 
s shown in Fig. 6, which typically include vital power (life) , 
mental power, apparent fearfulness, skill level, accuracy 
level, r^^.idual number of bullets on the arms, enemy search 
ability, attack range, direction of field of view (forward 
field of view), motional speed (speed), terror, offensive 
power, defensive power, continuous shooting ability of the 
arm, damage score (damage counter) , decreasing rate of 
bullets in a magazine of the arm (consumption level of 
magazine) , angle of field of view, sensitivity of field of 
view {field of view (sense)), short-distance of Tensive power, 
middle-distance offensive power, long-distance offensive 
power, dodge skill from short-distance attack by the leading 
character (dodge characteristic) , dodge skill from 
middle-disrance atrack by the leading character, dodge skill 
from lon^-d^^etance attack by the leading character, endurance 
power against short-distance attack by the leading character 
(defensive characteristic) , endurance power against 
middle-distance attack by the leading character, and 
endurance power against long-distance attack by rhe leading 
character . 

Other parameters specific to enemy characters include 
endurance power against attack by the leading character 
(stroke endurance) , endurance power against attack by the 
leading character using a flame thrower (fire endurance) , 
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endurance power against attack by the leading characrer using 
a water thrower (warer endurance), endurance power against 
arracJc by the leading character using an acid thrower (acid 
endurance) , endurance power againsr thuader shock caused by 
the leading character (thunder endurance) weak point ID, 
ability for pursuing the leading character (persistency) / and 
critical endurance - 

Among rhese, vital power, offensive powerr defensive 
power, and ciazuage score are expressed by values f rpm 0 ro 255^ 
which decrease depending on damage given by the leading 
characrer. The motional speed is expressed in 16 steps from 
0 to 15* The subjects listed from ^^mental power" "Co ^''enemy 
search ability", terror^ consumption level of magazine, and 
subjects listed from *^short-distance offensive power" to 
^^weak point ID" are expressed in percent (%) . 

The com:inuous shooring ability is expressed by the 
number of frames for displaying such continuous shooting. 
The attack range, direction of field of view (forward field 
of view) , angle of field of view, and sensitivity of field 
of view are individually expressed in a unit of **maya''- 

Parameters for the arms 33 owned by the leading character 
31 is composed as shown in Fig. 7/ which typically include 
range, weight (size) , offensive power, conrinuons shooting 
speed, number of loading, direction of field of view (forward 
field of view) , angle of field of view, sensitivity of field 
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Of view (field of view (sense)), bullet loading rime, at:t:ac)< 
range, shoocing accuracy, shorr-disiiance offensive power, 
middle-distanc* offensive power, long-distance offensive 
power, dodge skill from short-distance arrack by the enemy 
(dodge characteristic) , dodge skill from middle-distance 
attack by the enemy, dodge skill from long-distance attack 
by the enemy, endurance power againsr short^disr ance attack 
by the enemy (defensive characteristic) , endurance power 
against middle-distance attack by the enemy, and endurance 
pow©r against long-distance arrack by rhe enemy. 

Among these, the range, direction of field of view 
( f ojrward'=^ ^^,eld of view), angle of field of view, and 
sensitivity of field of view are expressed in meter (m) , and 
rhe offensive power is typically expressed by values from 0 
to 255. The weight is expressed in kilogram (kg) , the number 
of loading in values from 0 ro 1023, and the continuous 
shooting speed and bullet loading time in the number of frames 
for displaying such continuous shooting. The subjects 
listed from "^shooting accuracy''' to ^endurance power against 
long-distance attack by the enemy" are individually expressed 
in percent ( % ) . 

Display Conrrol based on Parameters 

Such individual parameters are read out from the optical 
disk 19 ^described in the above, and rhen stored in rhe 
paramerer storage section 14 shown in Fig. !• The control 
section 17 properly reads out the parameter from the parameter 
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sTiorage secrion X4 depending on a scene or siruarion, to 
thereby display under control behaviors of the leading 
character 31, enemy character 32 and arms 33 used by the 
leading T::ta'£iracter 31. 

A process flow of the ^controlled display based on such 
parameters will be explained referring to a flow chart of rig. 
8- The process flow Starrs when the main unit 1 starts the 
video game^ and the process by the control section 17 advances 
to step SI » 

In step Sl^ the control secrion 17 reads out paraxneters 
for the normal state from various parameters stored in the 
parameter storage section 14/ and then, in step S2 , displays 
under control the leading character 31 moving along a 
predetermined route while keeping a psychological state 
corresponded to such normal parameters - 

Sxast^iles of rhe parameters for the normal state of the 
leading character 31 read out from the parameter storage 
section 14 include mental power, terror and skill level as 
listed in Fig. 9. The individual values of such parameters 
for the normal state of the leading character 31 are ""l" for 
the mental power, ''^O.IS" for terror, and ""1" for skill level. 

The ^^mental power" parameter ranges from 0 to 1 
(corresponding to weak to strong) depending on the mental 
condition of the leading character; rhe ^^terror" parameter 
ranges also from 0 to 1 (corresponding to fearless to fearful) 
depending on the number or apparent fearfulness of the enemy 
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characters; and the "sKill level" paramerer ranges again from 
0 to 1 {corresponding ro less to much) depending on the number 
of times the game is executed, in which the leading character 
31 gains experience by repeating batrles with the enemy 
5 characcer 32. 

The enemy character 32 is programmed to attack the 
leading character 31 at predetermined points on the travel 
route. In step S3 in the flow chart shown in Fig. 8, the 
control section 17 determines whether the enemy character 32 
Mio which may attack the leading charact^jr 31 appeared or not ^ 
Q process thereof returns to step S2 when the enemy 

character 32 was not found, to thereby display under control 
actions of the leading character 31 based on the foregoing 
y parameters for the normal state. This allows the leading 
IrJ^ character 31 to keep on traveling along the predetermined 
route- 

On the contrary, when the enemy character 32 appeared, 
the control section 17 reads out in step S4 from the parameter 
storage section 14 the parameters of the leading character 
20 31 for the case of encountering with the enemy character 32. 

The parameters of the leading character 31 read out from 
the parameter storage section 14 for the case of encountering 
with the enemy character 32 include, as typically listed in 
Fig. 10^ those for mental power of the leading character, 
25 apparent fearfulness of the enemy character 32, number of the 
. enemies nearby, distance to the enemy character 32 and skill 
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level. 

As is Clear from Fig. lO, the individual values of such 
parameters of the leading character 31 for the case of 
encountering with the enemy character 32 are ""0.25" for the 
mental power, ^^0.1" for the apparent fearfulness of the enemy 
character 32, ""0.1" for the number of enemies nearby, ^^o" for 
the distance to the enemy character 32, and '"0 , 1" for the skill 
level - 

The control section 17 displays under control actions 
of the leading characrer 3X based on the parameters listed 
in Fig. ^SLO-r^for the case of encountering with the enemy 
characrer 32, where t^e display of such acrions of the leading 
character 31 can be alrered depending on the presence or 
y absence of voice input by the player in such controlled 
ri5 display, 

^ore specifically, the control section 17 determines 
in stop SS the presence or absence of the player' s voice input 
upon reading out the parameters of the leading character 31 
for the case of encountering with the enemy character 32, and 
the process thereof advances to step 39 when the voice input 
from the player is detected, and advances ro s-tep S6 when not 
derecced. 

ffe^ reached after detecting no voice input from 

the player, the conrrol section 17 displays under control the 
leading character 31 using parameters of such leading 
character 31 read out from the parameter storage secrlon 14 
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for the case of encountering the enemy character 32 without 
alteration . 

On the other hand in step 39, reached after detecting 
voice input from the player, the control section 17 alters 
the individual parameters of the leading character 32, read 
out from the parameter storage section 14 for the case of 
encountering the enemy character 32, into values 
corresponding to the player'^s voice input, and then in step 
S6, actions of the leading character 31 are displayed under 
control based on such altered values of the parameters. 
□ Fig, 11 shows an exemplary scene in which the enemy 

character 32 appeared in front of the leading character moving 
^ along the route. in such exemplary case, in order to make 
U the leading character 31 fight with the enemy character 32, 
415 the player not only controls the controller 2, but also gives 
instructions to the leading character 31 through voice such 
as ^'Take the fire thrower!'^ so as to designate an arm to be 
^ used for attacking the enemy character 32, and such as ^Aim 
at the belly 1" so as to designate a weak point of the enemy 
30 character 32 to be aimed at. 

The player's voice is picked up by the microphone 7 of 
the head set 3 shown in Fig. 3/ converted into sound signals, 
which are then supplied to the voice recognition section 13. 
The voice recognition section 13 analyzes meaning of the 
2$ phrase spoken by the player based on waveform pattern of such 

sound signals, and supplies the analytical results to the 

'3 h 
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conrroi section 17. The conrrol section 17 then alters the 
values of rhe individual parameters, read out in step 54, of 
the leading character 31 for the case of encounT:ering with 
the enemy character 32 based on such analytical results. 
5 Actions of nhe leading character 31 are displayed under 
control based on such altered parameters. 

In such exemplary case, in which the instructions of 
"^T-aJce rhe fire thrower!" and ^'Aim at the b«lly!" were made 
by the player^ the control section 17 allows the controlled 
fujo display such that the leading character 31 holds a fire 
J'i nhrower as the arms 33 and throws fire to the enemy character 
yy 32 using such fire thrower to thereby expel in as shown in 
U rig. 12. 

hi li^ step fi7 in the flow chart shown in Fig, 8, the control 

[15 section 17 determines whether rhe enemy character 32 was 

defeated or nor, and the operation of the main unit 1 advances 
\J to step 58 for the case the enemy character 32 was defeated^ 
r: and returns to step SS when not defeated. Then presence or 
absence of '^he player's voice input is determined in step SS 
20 as described in the above, and again in step S9 or step S6, 
actions of the leading character 31 are diispXa-yed under 
control based on the parameters corresponding to the presence 
or absence of the player's voice input. 

In step S9, whether rhe video game was completed either 
25 in response to defeat of the enemy character 32 or in response 
to instruction of end of the game issued by rhe player is 
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determined, and rhe entire routine of the flow charr shown 
in Fig. 8 is teritilnared wirhour any other operations when che 
end of the game was detected, and the operation of the control 
section 17 returns to step SI when the game is not: completed 
5 yet. The control section 17 then reads out the parameters 
of the leading character 31 for "the normal state from the 
parameter storage section 14, and displays under control the 
leading characrer 31 with the parameters for the normal 
psychological state so as to travel along a predetermined 

1^0 route . * 6 r?; 

Escaping Action from Enemy Character 
H While the above description dealt with the case rhat 

the leading character 31 fights wixh the enemy character 32, 
y the leading character 31 does not always fight with the 
[i5 encountered enemy character 32, and the actions thereof may 

differ depending on the psychological state (parametric 
^ values) . 

1-^ More specifically, when a value of the '^terror" 

parameter of rhe leading character 31 encountering with the 

30 enemy character 32 is higher than a predetermined value, the 
control section 17 displays under control the leading 
characte-rg^Ll such that running away from the enemy character 
32. Fig. 13 shows the individual parametric values for the 
leading character 31 in such siruarion. 

25 As is clear from Fig- 13, when the leading character 

31 runs away from the enemy character 32, the individual 
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values of such parameters are for the hir ratio of own 

attack, '"0.5" for the terror^ ^''O.d" for th© distance to the 
target, ^iQr^b" for tha number of enemies nearby, "^O.S" for the 
hit ratio of the enemy's attack, and ^O.e'' for the distance 
5 to the enemy. The control section 17 is allowed to display 
under control the leading character 31 such that running away 
from the enemy character 32 for example when the values for 
the "^terror" parameter exceeds ^^0.5". 

When the player encourages the leading character 31 
00 about to run away with a word Such as ^Hold oxit ! or *^Don' t 
^ run awayi", the control section 17 lowers the value for the 
yJ ^terror'' parameter by a predetermined value. If the lowered 
value for the ""terror'' parameter becomes ^O.n'' or below, the 
control section 17 displays under control actions of the 
^15 leading cjj^acter 31 based on the parameters for the normal 
T-.^ state as described previously referring to Fig. 9. The 
\j leading character 31 now has the normal psychological state, 
^ stops running away from the enemy character 32 and begins to 
advance along a predetermined route in a normal way of 
30 walking. 

Even i£ the player speaks the words, the controlled 
display of the leading character 31 such that running away 
will be retained by the control section 17 if the "^terror" 
parameter still remains at "'0.5" or above. In this case, the 
25 leading character 31 keeps on running away from the enemy 
character 32 disobeying the player. When the leading 
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Character 3X caiTie far enough from the enemy character 32, the 
control section 17 lowers the value of the ^"terror" parameter 
to thereby display under control the leading character 31 so 
as to have normal actions • 
^ Voice I nstruction for Cases other than Encountering Energy 
Charact e^^ 

The player watching the leading character 31 moving 
along the route may speak to such leading character 31 in the 
displayed scene such as ^^Watch out!'' or ^'^Be careful!" when 
ylO the play^jr £eels a sign of atorupc appearance of the ensmy 
J:::: character 32, upon receiving such voice input, the control 
yy section 17 typically raises the value of the ^'terror" 

parameter of the leading character 31 by a predetermined range, 
and displays under control the leading character based on such 
!^ IS raised parametric value. 

RJ Since the value of the ^terror^ parameter was raised 

^ predetermined range, the control section 17 displays 
r: under con-feriol the leading character 31 so as to make careful 
steps along the route while paying attention to the peripheral, 
20 which was altered from the previous normal steps. 

When the leading character 31 walking with careful sreps 
encounters with the enemy character 32 as expected, the 
contr<3l section 17 displays under control actions of the 
leading character 31 based on the parameters for the case 
25 encountering with the enemy character 32, which were 
previously explained referring to Fig. 10. 
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When rhe leading character 31 walking with careful steps 
did not encounter with the enemy character 32 and it was 
defined as no more dangerous, the player then gives voice 
instruction such as '''Out of danger. Forward normally". The 
5 • conrrol secrion 17 reads out the parameters for the normal 
psychological state according to such voice input as 
previously explained referring ro Fig. 3, to thereby displays 
acrions of the leading character 31 based on such parameters. 
Conversation of Player with Leading Character 
C>o Wh£Q6^the above descripricn may suggest that only the 

r. player one-sidedly gives instructions to the leading 
^ character 31, the actual game proceeds while allowing the 
y3 leading character 31 to occasionally ask the player something 
s or answer to the player, and allowing such player to reply 
i^jis to a question of the leading character 31 or give some 
instruction on the next action, to thereby control the 
O behavior of the leading character 31 through conversation 
therewith- The voice tone of the leading character 31 is 
programmed to vary depending on the voice tone in the response 
20 or instruction of the player. 

Fi<g. 14 is a flow chart showing a process flow according 
to whichi-feh;^ leading character 31 completes a response to a 
player in a voice tone corresponded to the player' s voice 
tone- 

25 The process flow starts from step Sll when the video 

game begins. The control section 17 reads out from the 
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SBieccion/event table storage section 20 a sound signal for 
a -Question issued by the leading character 31 according to 
a prederermined timing^ and send the signal to the head set 
3 worn by the player. 
5 In srep Sll^ the control section 17 discriminates 

whether the leading character 31 asked a question ro the 
player or not by discriminating whether the sound signal for 
the question issued by the leading character 31 was sent, to 
the head set 3 worn by the player or not. The conrrol section 
.10 17 is brought into a stand-by mode utitii a question is issued 
O for the case the leading character 31 did not ask any question, 
hj and the process thereof advances to step S12 for the case the 
ri question was detected. 

When the question is issued by the leading character 
gi5 31, the player will answer the question- The player's voice 
fll as the answer is picked up by the microphone 7 of the head 
rt set 3, and supplied as sound signal to the voice level 
O detection section 12 and the voice recognition section 13. 
In step S12^,the voice level detection section 12 determines 
20 the player's voice level by detecting the level of the sound 
signal, and sends a level detection output to the control 
section 17. In step S13, the voice recognition section 13 
analyzes meaning of tlie player's voice based on ttie waveform 
pattern of the sound signal, and sends the analytical results 
25 to the control section 17 • 

Next, "the control section 17 detects the player's voice 
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tone based on the level detection output from the voice level 
detection section 12 and the analytical result of the meaning 
of the player's voice from the voice recognition section 13, 
and then registers the detection result into ton© groups 
5 classif i^ti'r by voice tones. 

While the following description deals with the case in 
which the player'' s voice tone is detected based on the level 
detection output from the voice level detection section 12 
and the analytical result of the meaning of the player' s voice 
'^tn from tne voice recognition section 13, i-t is also allowable 
Q that the player's voice tone is detected based only on the 
^1 analytical result of the meaning of the player''s voice. 

Nevertheless, the detection of the voice tone involving level 
yi| detection output from the voice level detection section 12 
Is^is will raise accuracy in such detection. 

If^ Each voice tone group is assigned with a counter 10, 

2;f a value =^€'jwhich is incremented by one when the group is 
M. registered with the player' s voice tone after being 
classified by the control section 17. 
20 Such registration operation is repeated each time the 

player' s voice tone is analyzed, so rhat the count of the voice 
tone group corresponded to a frequently used voice tone will 
be incremented by one as the video game proceeds (each time 
the player utters). Thus, a tendency in the player's voice 
2S tone which is frequently used is expressed by the counts of 
the individual counters 10, 
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In srep SX6, the control section 17 discriminates 
wherner there is any group expressing a tendency in the 
player's voice tone or not by confirming whether the count 
value of each voice tone group equals to or exceeds a 
prederermlned count value or not. If there is a group having 
a count value equals to or exceeds the predetermined value, 
a sound signal of the leading character 31 is read out in step 
S17 f rom-. -^ti,© selection/event table storage section 20 so as 
to produce a response corresponded to such group, and the 
sound signal is then sent ro the speaker unit 61? o£ the head, 
set 3 worn by the player. Thus, the response of the leading 
character 31 is produced in a voice tone corresponded to the 
voice tone of the player. 

On the other hand, the count values of the individual 
counters 10 can increase only within a range below a 
predetermined value when the player is in a period shortly 
after the beginning of the game or the player uses various 
voice tones • 

In such case, the control section 17 discriminates that 
there is no^group expressing a tendency in the player's voice 
tione, a-nd then in step SIS reads out from rhe selec-t ion /event 
table storage section 20 a sound signal of the leading 
character 31 so as to make a response corresponded to the 
currently detected player'' s voice, and sends the sound signal 
to the speaker unit 6b of the head set 3 worn by the player. 
Thus, the response of the leading character 31 is produced 
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again in a voice tone corresponded to rhe player' s voice tone. 

The above description will further be detailed assuming 
that the leading character 31 is a female character. As shown 
in Fig. 4/ when the leading characrer 31 encounters with the 
enemy character 32, the control section 17 reads out voice 
information such as "^Damn you!'', "'Don't be like a fool and 
show me the weak point!" or che li]ce from those stored in the 
selection/event table storage section 20, and sends it to che 
head set 3 worn by the player. 

When instructions such as ''^Take the fire thrower I and 
"Aim at the belly!" were given by the player in response to 
such saying of the leading character 31, the control section 
17 controls the display so as to make the leading character 
31 have a fire thrower as an arm 33 and expel the enemy 
character 32 by throwing fire using such fire thrower. 

On the other hand, when no instruction was given by the 
player to the leading character 31, the control section 17 
selects a voice information such as "'Are you hearing?'" from 
those stored in the selection/event table storage section 20, 
and sends it to the head set 3 worn by the player, to thereby 
repeat the asking by the leading character 31 and prompt an 
answer from the player. 

The player now gives answers to the leading character 
31, which may be given in a variety of voice tones • 

Fig. 15 shows exemplary positive answers to the question 
''Are you hearing?" by the leading character 31, which include 
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^^Yes, I am-", ^^Sure-", "Yeah.'" and ^\Hum, so what?". 

"'Yes, I azh.'' corresponds to the polite voice tone, 
**Sure. " to the gentle voice tone, '"Yeah. " to rhe general voice 
tone, ami^ ?Kum, so whar?'' to rhe negligent voice tone. 
5 The conrrol section 17 discriminates such player's 

voice tone in the processes from steps S12 zo S14 shown in 
Fig. 14, classifies rhem inro any one of ^^polite tone group", 
^^genrle tone group"^ ^'general tone group" and ^^netgl i^ent tone 
group", and increments the counter 10 of a corresponding group 
^0 by one • 

O Executing such increment every time the player's voice 

rone is analyzed will produce a tendency Of the player' s voice 
tone as being expressed by the count values of the individual 

l.y voice tone groups as described in the above* So that if there 

H5 is a group expressing a tendency of the player's voice tone, 
rhe cont2f©}^, section 17 reads out, from the selection/event 

2: table storage section 20, voice information which belongs to 
a group corresponded to the player'^s voice tone, and supplies 
rhe voice information to the head set 3 worn by the player. 
20 On the contrary, if there is no group expressing a tendency 
Qf the player's voice "Cone, the control section X7 rea<is o\it 
in step S19 a currently analyzed voice information 
corresponded to the player' s voice tone from the 
selecrion/event table srorage section 20^ and sends such 
25 voice information to the head set 3 worn by the player, 

In such case for example, when the player answers as 
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"Yes, I aTH*'' which belongs to rhe ""polire tone group" in 
response ro the quesrion of ^^Atq you hearing?" by the leading 
character 31/ the control section 17 reads out voice 
information of the leading character 31 such as ^'Oops I Your 
5 polire answer makes me ill!", for example, from the 

select ion/evenr stoirage section 20, and then sends Che voice 
information to the head set 3 worn by the player. 

Similarly, in the case that the player gave an an&wez: 
of ^^Sure." or ^^Yeah," which belong to the ""genrle tone group" 
^ and *^g-erx^ra^l tone group", respectively^ in response ro' the 
j^'; quesrion of ^^Are you hearing?" by the leading character 31, 
yy rhe control section X7 reads out a casual voice information 
^ of the leading characrer 31 such as ^'^OKl", for example, from 
J"' the selection/event storage section 20, and then sends the 
nf^ voice information to the head set 3 worn by the player. 

Similarly again^ in the case that r.he player gave an 

: 

Q answer of ^'Hum, so what?" which belong to the ^'negligent tone 
group" in response to the question of ^^Are you hearing?" by 
the leading characrer 31, the control section 17 reads out 

20 voice information of the leading character 31 such that ''Why 
can you say in that way? I'm mad!", for s^cample, from the 
selectioTi/event storage section 20, and then sends the voice 
information ro the head set 3 worn by the player. 

The above description dealt wirh an exemplary case that 

25 rhe player gave a positive answer to the leading character 
31. On the contrary, an exemplary case thar rhe player gave 
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a nega-cive answer to such guesrion Is shown in Fig. IS, 

The negarives answer to the question '^Are you hearing?'' 
by the leading character 31 include ^^No, I'm nor.", "^^isio, 
sorry.", **No." and ^^No, so whar?". 

"No, I'm not," corresponds to the polite voice tone, 
^^No, sorry to the gentle voice tone, ^^No." uo the general 
voice tone, and ^No, so whar?" to the negligent voice tone. 
When the player gave an answer of ^^No, I'm not." which 
belongs to the ^^polite tone group" in response to the question 
o£ "Are you hearing?" fey the leading character 31, the control 
section 3-7^^^reads out voice information of the leading 
character 31 such that ^'Listen to me carefully, then!", for 
example, from the selection/event storage section 20, and 
then sends the voice information to the head set 3 worn bv 
the player. 

Similarly, in the case that the player gave an answer 
of ^^No, sorry." which belongs to the ^^gentle tone group" in 
response to the question of "*Are you hearing?" by the leading 
character 31, the control section 17 reads out voice 
information of the leading character 31 such as "^Then listen 
to me carefully 'cause I'll tell you once more I for eacample, 
from the selection/event storage section 20, and then sends 
the voice information ^to the head set 3 worn by the player. 

Similarly again, in the case that the player gave an 
answer of **No," which belongs to the ^^gencral tone group" in 
response to the question of '^Are you hearing?" by the leading 



32 



SCO11O90SQO 



ohajractsr 31, the control section 17 reads out voice 
information of the leading charact<sr 31 such as ^"Why ain't 
you listening to me? Don' t make me repeat the same phrase 1 
for example, from the selection/event srorage section 20, and 
5 then sends rhe voice information to the head set 3 worn by 
rhe player. 

Still similarly, in the case rhat the player gave an 
answer of -No, so what?- which belongs to the >^negligent ton© 
group'' in response to the question of "'Are you hearing?'' by 
I| the leading character 31, the control section 17 reads out 
.J voice information of the leading character 31 such as *^Hey 
-J you! Are you really going to help me? Lisren to me 
|j carefully ' cause I'll tell you once more I , for example, from 
the selection/event storage section 20, and then sends the 
voice information to the head set 3 worn by the player. 

In thf s video game, the player and the leading character 
31 are in a partnership for fighting with a common enemy- With 
such video game machine of this embodiment, the personality 
of the player can be simulated by the personality of the game 
character by altering the voice tone of the leading character 
31. corresponding to that of the player. This successfully 
makes the player feel familiar to the game character and 
promotes empathy of the player, to thereby further enhance 
the enjoyment of the video game. 
^5 '^^-e above conversation between the player and the 

leading character 31 is none other than one example, and it 
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is to b« undorsrood. "chat the video game proceeds based on any 
. other conversation berween the player and the leading 
character 31, in which the voice tone of the leading character 

31 can vary depending on the voice tone of the player. 

. 5 After such control of the response for the leading 

Character 31, the control section 17 deterinines in step S18 
in Fig. 54 T^hcther such battle-type video game is completed 
by discriminating whether the player issued an instx-uction 
of end of the game or not, or whether a series of the game 
|.^0 story came to th® end or not- For thie case the end of the 
p game V7as detected, the entire routine shown in the flow chart 
.will complete without any other processing. For the case the 

yy 

end of the game was not detected, the process goes back to 
U step S12, and the foregoing voice tone discrimination, 
ti5 group-classified registration and responding operation of 
1?; the leading character 31 depending on the voice tone groups 
'j^ or on the player's voice tone will be repeated until the game 

over will be discriminated in step S18. 

Effect o£ fet^e Embodiment 
20 AS is clear from the above description, when a 

predetermined event such as appearance of rhe «s:neiny character 

32 occurred, the video game machine of this embodiment reads 
out parameters corresponded to such event to thereby control 
display of leading character's behavior toased on such 

25 parameters, where such display of the leading character 31 
can also be controlled by modifying such parameters according 
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to t^e player's voice when it is recognized. This allows 
control of rhe leading character 31 both through the 
conrroller and sound and voice input - 

Since the leading characrer 31 is controllable not only 
5 through rhe conrroller but also through the voice inpur, rhe 
player is readily empathized with the video game, which makes 
the player positively parricipate the game* Such pleasure 
in operating the game character enhances snjoymem; ot rhe 
video game. 

IXiO Sin,5:e^^also rhe conrrol section 17 of course controls 

Ll. behaviors of the game characters based on rhe individual 
'y] paramerers, rhe behaviors of the game characters do not always 
r^- depend on rhe voice input by the player, which provides 

another enjoyment of such video game, 
is Since the video game machine of this embodiment can 

rj modify rhe voice rone of the leading character 31 
'1 corresponding to that of the player, the personality of rhe 

leading character 31 can be marched to that of the player. 

This successfully malces the player feel familiar -bo the game 
20 character and promotes empathy of the player, ro thereby 

further enhance the enjoymenr of thie video gsme • 

While the above description dealt with the case in which 

the leading character 31 is operated by voice inpur for the 

simplicity of the undersr anding of the embodiment, it is also 
25 allowable to operate the enemy character 32 by such voice 

input. For example, operating the leading characrer 31 by 
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one player and the enemy character 32 by the other player 
allows mutual attack through voice inputs^ which will enhance 
interest of the video game. 

While the above descriprion dealt with the case in which 
rhe present invention was applied to a battle-type video game^ 
any other types of video games will be allowable provided that 
the objects such as game characters are operated through voice 
input . 

The embodiment described in rhe above is only part of 
the examples of rhe present invention. Ir is therefore to 
be understood that the present invention may be practiced in 
any modifications depending on the design or the like 
otherwise than as specifically described herein without 
departing from the scope and the technical spirit rhereof . 

5 6 ^ 
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